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Abstract 

A system comprised of an elastic solid and its response to an exter- 
nal random force sequence is shown to behave based on the principles 
of the theory of algorithmic complexity and randomness. The solid dis- 
torts the randomness of an input force sequence in a way proportional 
to its algorithmic complexity. We demonstrate this by numerical anal- 
ysis of a one-dimensional vibrating elastic solid (the system) on which 
we apply a maximally random input force. The level of complexity 
of the system is controlled via external parameters. The output re- 
sponse is the field of displacements observed at several positions on 
the body. The algorithmic complexity and stochasticity of the result- 
ing output displacement sequence is measured and compared against 
the complexity of the system. The results show that the higher the sys- 
tem complexity the more random-deficient the output sequence. This 
agrees with the theory introduced in [16] which states that physical 
systems such as this behave as algorithmic selection-rules which act on 
random actions in their surroundings. 

1 Introduction 

Consider an elastic beam having a length L, (for instance, a bridge). It has 
some finite descriptive complexity consisting of all the information contained 
in the engineering design documents. These documents can be put into a 
single computer file that can be represented by a finite binary string z. This 



binary sequence has an algorithmic complexity which is defined as the length 
of the shortest computer program that can generate the sequence. This is 
defined as the Kolmogorov complexity K(z) of the string z (see [2]). Now 
consider a random input force sequence applied at one of the two ends of 
the bridge, for instance, suppose there is a person jumping up and down 
sporadically on the bridge at its entrance (position 0). Denote by x the 
binary sequence representing this up/down symbols over some fixed time- 
interval [0, T\. Intuitively, being that x is random makes its complexity K(x) 
maximal and hence close to its actual length £(x) since there is no redundancy 
in the patterns of x that can be used to compress it significantly below its 
length. Now consider an observer which measures the displacements on the 
beam at its other end (position L). He records this over the time interval 
[0, T] and compares it to a fixed threshold thereby producing a binary output 
sequence y consisting of up/down symbols that represent the movement of 
the beam at position L. This sequence has a finite algorithmic complexity 
K{y). In this paper we show that for such a physical system, the system 
complexity K(z), the output complexity K(y) and its level of randomness 
are all related and there exist statistically significant correlations between 
them. 

Ratsaby introduced a quantitative definition of the information con- 
tent of a static structure (a solid) and explained its relationship to the sta- 
bility and symmetry of the solid. His model is based on concepts of the 
theory of algorithmic information and randomness. He modeled a solid as a 
selection rule of a finite algorithmic complexity which acts on an incoming 
random sequence of particles in the surroundings. This selection mechanism 
is intrinsically connected to the solid's complex non-linear structure (partly a 
consequence of its internal atomic vibrations) and its intricate time-response 
to external stimulus. As postulated in [16], a simple solid is one whose infor- 
mation content is small. Its selection behavior is of low complexity since it 
can be described by a more concise time-response model (shorter computer 
program). The solid's stability over time is explained in [16J by using the 
stochastic property of the frequency stability of a random sequence. Accord- 
ingly, the physical stability of the system (solid) is intrinsically and inversely 
proportional to the ability of the solid to deform (or distort) the input se- 
quence and make it less random, i.e., more random-deficient. 

The current paper presents first evidence that validate the model of [IB] . 
We choose to simulate a solid structure which consists of a one-dimensional 
vibrating solid-beam to which we apply a random input force sequence and 
observe the displacement of the beam at its other end for a finite interval 
of time. We determine empirically the relationship between the algorithmic 
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complexity of the structure to the stochasticity of the output response. The 
relationship confirms the theory of |16| . 

The paper is organized as follows: in section|2]we give a brief introduction 
to the main concepts of the area of algorithmic complexity and randomness. 
In section [3] we state concisely the aim of the paper. In section [4] we de- 
velop the equations that describe the solid deformations and compute the 
numerical equations needed to produce the computer simulation of the solid's 
response to external forces. In section [5] we state the experimental setup, 
results and analysis. In section [6] we state the conclusions. 

2 Background 



Kolmogorov [S] proposed to measure the conditional complexity of a finite 
object x given a finite object y by the length of the shortest binary sequence 
7r (a program for computing x) which consists of Os and Is and which recon- 
structs x given y. Formally, this is defined as 



where £(ir) is the length of the sequence it, (ft is a universal partial recur- 
sive function which acts as a description method, i.e., when provided with 
input (ir, y) it gives a specification for x. The word universal means that 
the function (ft can emulate any Turing machine (hence any partial recursive 
function). One can view (ft as a universal computer that can interpret any 
programming language and accept any valid program ir. The Kolmogorov 
complexity of x given y as defined in ([!]) is the length of the shortest pro- 
gram that generates x on this computer given y as input. The special case 
of y being the empty binary sequence gives the unconditional Kolmogorov 
complexity K(x). 

Let H be the space of all finite binary sequences and denote by H n the 
set of all finite binary sequences of length n. An admissible selection rule 
R [TU] is a partial recursive function on H that picks certain bits from a 
binary sequence x. Let R(x) denote the selected subsequence. By K(R\n) 
we mean the length of the shortest program computing the subsequence 
R{x) given n. Kolmogorov introduced a notion of randomness deficiency 
5{x\ri) of a finite sequence x E E n where 5(x\n) = n — K(x\n) and K(x\n) 
is the Kolmogorov complexity of x not accounting for its length n, i.e., it 
is a measure of complexity of the information that codes only the specific 
pattern of Os and Is in x without the bits that encode the length of x (which 
is log n bits). Randomness deficiency measures the opposite of chaoticity of a 



K(x\y) 



min{^(7r) : (p(ir, y) = x} 



(1) 
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sequence. The more regular the sequence the less complex (chaotic) and the 
higher its deficiency. An infinitely long binary sequence is regarded random 
if it satisfies the principle of stability of the frequency of Is for any of its 
subsequences that are obtained by an admissible selection rule [TU] . 

In [5] it was shown that the stochasticity of a finite binary sequence x 
may be precisely expressed by the deviation of the frequency of ones from 
some < p < 1, for any subsequence of x selected by an admissible selection 
rule R of finite complexity K{R\n). The chaoticity of x is the opposite of its 
randomness deficiency, i.e., it is large if its Kolmogorov complexity is close to 
its length n. The works of [5J [TJ [5J [TU] relate this chaoticity to stochasticity. 
In PO it is shown that chaoticity implies stochasticity. This can be seen 
from the following relationship (withp = \ ): 



u(R(x)) - \ 



l 5{x\n) + K{R\n)+2logK{R\n) 

- 1 W*)) () 



where for a binary sequence s, we denote by u(s) = the frequency of Is 
in s where #(s) denotes the number of Is in s, and £(R(x)) is the length of 
the subsequence selected by R, c > is some absolute constant. From this we 
see that as the chaoticity of x grows (randomness deficiency decreases) the 
stochasticity of the selected subsequence grows (bias from \ decreases). The 
information content of the selection rule, namely K(R\n), has a direct effect 
on this relationship: the lower K(R\n) the stronger the stability (smaller 
deviation of the frequency of Is from ^)- 



3 Aim of the paper 

In this paper we provide first evidence that the basic notion of randomness 
and its relationship to complexity (as discussed in the previous section) un- 
derlie the behavior of physical systems. This supports the ideas introduced in 
[IB] . We focus on a system composed of a vibrating elastic solid (described by 
the classical equations of solid mechanics) and its interaction with a random 
input force. We show that as a result of this interaction, the deformation of 
the solid over time can be described as an output sequence whose stochastic 
and algorithmic properties follow those of an output subsequence selected by 
a selection rule of a finite complexity. Based on a large sample of computer- 
generated simulations of such solids we provide statistically significant results 
that show that the complexity of the system inversely affects the complexity 
of the solid deformations (observed output) and its stochasticity agrees with 
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the theory ([2]). The next section describes the solid's mechanical equations. 

4 The solid's equations 

The solid consists of an elastic homogeneous and one- dimensional beam of 
length L. Let us denote by x the position on the beam so that < x < L and 
by a? the unit vector on the x-axis. Denote by / = f(x, t)lt a force applied 
at time t on position x in the direction of ~afr. We define \sy~Tt = u(x, t)lt the 
displacement at time t on x. The classical equation which describes the field 
of displacements u at a specific position and time when a force / is applied 
is as follows: 



f d 2 u E d 2 u\ , . . . 

^~7^J (;K '* ) = f(^(.0<x<L,t>0), (3) 

where -E is Young's modulus (the ratio of stress to corresponding strain 
when the beam behaves elastically) , and p is the mass density. We impose 
the following boundary conditions: 



u(0, t) = u(L, t) = 0, Vt > 0, (4) 

i.e., the beam is fixed at its two ends so the only displacements is due to 
internal elasticity stresses of the material. Let uq(x),ui(x) be two given 
functions that satisfy uq(0) = uo(L) = 0. As initial conditions we set the 
following, 



u(x, 0) = uo(x), < x < L, (5) 
— (x,0) = Ul (x),0<x<L. (6) 



Equations (3|6) represent the model that describes the deformations of the 



elastic solid. In order to simulate the response of the solid to external forces 
we use the following numerical approximation. This is performed by intro- 
ducing a regular mesh of the [0, L] interval with a constant step Ax such 
that N + 2 equally spaced points are distributed on [0, L], Specifically, we 
have the following mesh: xq = 0, Xj = Xj_i + Ax, 1 < i < N + 1, xn + \ = L 
and Ax = j/^- 

Similarly, if time t belongs to the interval [0,T], we introduce M + 1 
discrete time points to = 0, t n = nAt, 1 < n < M, where At = jj. Let us 
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introduce the approximation sequence u(j,n), 1 < j < N and 1 < n < M 
such that u(j,n) u(xj,t n ), where u is solution of (3|6). 

Let us also denote by f(j, n) = f(xj,t n ). We consider the following finite 
differences scheme to get an approximation of (|3]{6]): 



u(j,n+ 1) 



u(0, n) 
u(j,0) 
u(j, 1) 



2u(j, n) - u{j, n - 1) + ( At) 2 f(j, n) 



+ 



At\ E 

Ax 



u(j + 1, n) - 2u(j, n) + u(j - 1, n)] , (7) 



u(N + l,n) = 0, 

Uo(Xj), 

u (xj) + (At)ui(xj) 



(9) 
(10) 



provided that the following CFL stability condition on the solid's 
parameters is satisfied, 

p Ax 

In the next section we describe the experimental setup and results 
produced by d7 10 ). 



5 Experimental results 

We performed a series of experiments which consisted of several hundreds 
simulation trials of the response of a vibrating solid (henceforth called a 
system) to an input force sequence. We used the numerical equations of 
section [4] as the solid's model. As a choice of parameters we took L = 20, 
T = 70, E = 0.7, p = 0.4, N = 30, M = 200. 

A system consists of a solid whose length is divided into 31 positions, 
0, 1, ... ,30. A force sequence /(15,n) is applied at position 15 while for all 
remaining positions the applied force is of zero magnitude. The non-zero 
force sequence /(15,n) makes the solid vibrate a priori hence we call the 
system a vibrating solid. This force sequence consists of a series of ternary 
values —1,0,-1-1 scaled by a constant of 30. The length of the sequence 
is 200 and the symbols are obtained sequentially by a repeated series of 
random draws using the random variable T with the following probability 
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distribution: let < p < 1, then T takes the value with probability 1 — p, 
the value +1 with probability |, and —1 with probability |. The complexity 
of the sequence is controlled by the choice of p. We used a different p for 
different trials by randomly picking its value and using it as the parameter 
value p of the distribution of the random variable T . 

To the system we apply an input force sequence 7(1, n) at position 1 
consisting of 200 randomly drawn binary values +1 and —1 each with prob- 
ability V 2 an d scaled by a constant 10. Note that this input force is applied 
to a vibrating solid (as mentioned above). As the output of the system, 
we observe the displacement sequences at five positions u(N — 5,n), . . ., 
u(N — l,n), 1 < n < 200 and convert their values a from real to ternary 
V(a) using the following rule: given a G R then V(a) = +1, and —1 if 
a > t, \a\ < t and a < — r, respectively, with r = 0.1. We then append these 
five ternary sequences together to form a single ternary output sequence of 
length 1000 (henceforth this is called the output sequence). We also consider 
the subsequence of this output sequence which consists only of the values 
+1, —1, i.e., without the zeros (we call this the output subsequence). 

As an estimate of the complexity K(x) of a sequence x we use a standard 
compression algorithm (Gzip, which is a variation of the algorithm of |20| ) 
to compress x. The length of the resulting compressed version of x is used 
as an approximation of K(x). Henceforth, when we say system complexity 
we mean the length of the compressed version of the sequence consisting of 
all applied forces appended sequentially into one string with 31 • 200 = 6200 
ternary symbols (in our experiments, all but the /(15,n) force are just all- 
zeros hence in this 6200-long string approximately only 200 bits contain 
information) . The output complexity is the length of the compressed version 
of the ternary output sequence. 

Let M denote the ratio of the compressed length divided by the un- 
compressed length of the system and let O denote this ratio for the output 
sequence. A large M (or O) means that the compressed length is larger hence 
the complexity of the system (or output sequence) is larger. We sometime 
simply refer to M and O as the system and output complexity, respectively. 
Figure [T] displays two sets of trials. 

In each trial of set (a) a random input force sequence was applied at 
position 1 (as described above). In each trial of set (b) no input sequence 
was applied. As is seen, the resulting behavior is clearly different in each of 
the two sets of trials. With an input present, as the complexity M increases 
there appears to be a decreasing trend in the value of O and an increase in 
the spread, i.e., the range of possible values of O. With no input, both O 
and its spread of values are basically constant with respect to M. 
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Figure 1: Output's complexity O versus the complexity M, (a) with random 
force input, (b) with no input 



In Figure [2] we plot the frequency of Is in the output subsequence (this is 
the number of Is divided by the number of non-zero symbols in the output 
sequence). 

As can be seen, with an increase in the complexity there appears to be 
an increase in the spread of possible frequency values. Before we further 
discuss these results we proceed to perform the statistical tests. 



5.1 Analysis 

In order to test the significance of these results we estimate the output com- 
plexity O as a function of the complexity M. Denote by X and Y the 
random variables corresponding to M and O, respectively. Let the underly- 
ing conditional probability distribution function be P(Y\X) with marginals 
P(X), P(Y), As a sample we use the set of trials of Figure 1(a), denoted 
by S = {(xi,yi)}^i with cardinality N = 723, and do linear regression in 
order to estimate Y with dependence on X. Figure [3] shows the resulting 
estimate, 

Y(X) = 0.341 — 2.284 A, (11) 

surrounded by the 95% confidence limits for the regression line, i.e., the 
actual regression line of the population falls within the limits defined by the 
two curved dashed lines. 

The following summarizes the accuracy of this linear regression estimate: 
R 2 = .246187335 is the coeeficient of determination which measures the re- 
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Figure 2: Output frequeny of Is versus M 



duction in total variation of Y due to X and is denned as R 2 = 1 — (SSr/SS) 

with SSr = {vi ~ Y( x i)) being the sum of squares of the residuals, 

SS = J2i(lH~y) 2 the total variation and y = j? J2i Vi ■ The square 
root R is the coeeficient of correlation between the independent variable 
X and dependent variable Y, The standard error SE = .015128505 where 

SE = J jjSSr. Dividing SSr and SS by their degrees of freedom and tak- 
ing their ratio F = SS/SS R as an overall F test gives F(l, 724) = 236.4508 
which amounts to a p-vslue less than 0.000000. Thus with very high confi- 
dence the residual variance differs from the total variation hence the linear 
estimate Y(X) explains well the variation of Y. The distribution of the 
residuals (shown in Figure Q is very close to the normal distribution and 
the Durbin- Watson d value is 1.994 which implies that the assumptions on 
the residuals being uncorrelated and normaly distributed are met. 

Next, from Figure 1(a) it is evident that as the complexity X increases 
the spread of the output complexity Y increases. To quantify this assertion 
let us represent this spread by the random variable 



Z(X, Y) = Y — min y. 

y.P(y\X)>0 



(12) 



As we have done above for Y we now estimate Z with dependence on X (the 
model is shown only the value of X and asked to predict Z). We form the 
following sample (based on 5), 

C = {{ x ii z i)\i=\ i z i = Hi 



mm 



xj£NN(xi,k) 



Vj 



(13) 
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Figure 3: Estimate for output complexity Y as a function of complexity X 

where NN(x, k) denotes the set of k nearest sample point Xj to x satisfying 
Xj < x. Figure [5] shows the resulting estimate equation (based on k = 7), 

Z{X) = -0.028 + 1.35 X 

for the regression line. This verfies the increase in the value of Z (i.e., in 
the spread of the output complexity Y) as the complexity X increases. The 
following summarizes the accuracy of this regression estimate: R 2 = .098, 
the F-ratio is F(l>724) = 79.548 with a p-level smaller than .000000. The 
standard error of the estimate is SE = .015413 with a Durbin- Watson d = 
1.938. Thus the estimator Z(X) accurately captures the variability of Z, i.e., 
the spread of output complexity Y, Figure [6] displays the distribution of the 
residuals. 

As mentioned above, Figure [T|(b) shows that when no input is present 
the behavior of the output complexity is almost unaffected by the system's 
complexity. To test this, we take the set of trials used in Figure [TJb) and 
study the correlation between the output complexity Y and the system com- 
plexity X. As shown in Figure [7] there is hardly any correlation between 
them and the slope of the regression is almost zero. 
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Figure 4: Distribution of the residuals y\ — Y(x{ 



We already commented on the increasing spread of possible frequency 
values of the output subsequence (Figure [2| as the system's complexity in- 
creases (with a random input sequence being applied). Denote by Y the 
probability of having a +1 appear in the output subsequence and let X be 
the system's complexity. Let us define the following random variable 



W{X) 



max y — mm y 

y.P(y\X)>0 y:P(y\X)>0 



to represent the spread in the possible values of the probability of +1. We 
form the following sample (based on S), 

C' = {(xi, Wi)}* =1 , Wi = max Vj - mm Vj (14) 

Xj£NN(xi,k) Xj£NN(xi,k) 

with k = 7. Figure [8] shows (on the top scatter plot with red x symbols) the 
frequency of Is in the output subsequence versus the system complexity X. 
The bottom plot (with blue A) shows the sample Q' with the w component 
on the same vertical axis. 

We estimate W based on (' first transforming the Wi values to wf and 
then doing linear regression to estimate W 2 . Figure [9] shows the resulting 
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Figure 5: Estimate of the spread in output complexity Z as a function of 
the system's complexity X 



estimate equation —0.023 + 1.083 X for W 2 . It follows that the estimate of 
W is 

W{X) = V1.083X- 0.023. (15) 

This verfies the increasing trend in the spread of values of the frequency 
of Is as the system's complexity X increases. The following summarizes 
the accuracy of this linear regression estimate: R 2 = .135, the F-ratio is 
F(l,724) = 113.06 with a p-level smaller than .00000. The standard error 
of the estimate is SE = .01037 and the Durbin- Watson d = 1.71. The 



distribution of the residuals is shown in Figure 10 



5.2 Some more details on the simulations 

Several additional graphs showing additional details of the above experiments 
are shown below. Figure [TT] shows the observed system description rate M 
(scatter plot in blue) and the entropy (the minimal expected number of bits 
per character) used for the system description (red solid curve). They are 
plotted versus the probability parameter p (in the range < p < 1) used to 
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Figure 6: Distribution of residuals for z% — Z(xi,yi) 



generate the random force sequence at position 15 of the solid. It follows from 
the procedure (described above) of generating the system's vibrating force 
that the entropy of the random variable T is H(p) = —(1 — p) log(l — p) — 



plog |. As seen from Figure 11 in order to get a higher system complexity 
one needs to draw a force sequence with a parameter p closer to 1/2. There 
is some additional textual information (145 bytes) appended into each of 
the files that contain the 6200-long ternary string that describes the system. 
Since M is the ratio of the compressed to uncompressed versions (the actual 
uncompressed length as reported by the operating system is 6377 bytes) 
then to get the rate for the number of bits per character used to describe the 
system (considering just the 145-byte textual information and the 200-byte 
force sequence at position 15) we multiply M by 6377 • 8 and divide by 345. 

The next series of figures show examples of the actual solid's response 
(displacement u is shown on the z-axis) over time (y-axis) along the posi- 
tions of the solid (x-axis). In all, the input sequence is maximally random 
with probability 1 /2 for +1, —1. The magnitude of the input force sequence 
is 10 and the magnitude of the system's vibrating force sequence is 30. The 
two force sequences are superimposed on the same 3D-plot that displays the 
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Figure 7: The no-input scatter plot of output complexity Y versus system's 
complexity X 



displacement response. The output sequence is taken as the concatenation of 
the string obtained from the displacement at the last five positions (appear- 
ing on the plot to be closest to the reader). Figure 12 shows the response 
to a system of high complexity. Figure [13] shows a trial without a system 
force. This represents a low- complexity system. Figure [14] is the response 
of a system of a mid-level complexity. Figures 15 and 16 show the response 
when no input force is applied. 



6 Conclusions 

Based on these results, it is clear that when a random input sequence is 
applied to the vibrating solid (system) the observed output sequence is not 
simply a result of the random vibrating force sequence which is part of the 
system (applied at position 15) but is a direct consequence of the interaction 
of the system with an external random input force-when no input is present 
no significant correlation exists between the system and output complexities. 
The strong negative correlation between these two complexities (Tl11 suggests 
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Figure 8: Scatter plot of frequency of Is in the output subsequence (top 
cluster of red xs). The corresponding sample (' used to estimate the spread 
W as a function of the system's complexity X (bottom plot of blue A) 

that the system distorts the input randomness and produces a less complex 
output sequence. This agrees with the model introduced in [IB] which says 
that a solid effectively acts as a selection rule picking bits from the input 
sequence to produce a less random output. This is evident in the significant 
decrease in the output complexity (Figure [3| and increase in its spread of 
values (Figure [5]) indicating that the possibility of producing a less-complex 
output sequence increases as the system's complexity rises. 

The selected subsequence consists of ±1 with zeroes deleted. Being less 
chaotic, its stochastic level decreases. This is evident in the increase in the 
square of the spread of values of the frequency of l's (Figure [9]). The higher 
the system complexity, the higher the spread, i.e., the larger the bias from 1/2, 
the more the chance that the output sequence be less chaotic and random. 
If we divide the compressed length of the system by the length of the output 
(binary) subsequence and denote it by X' then re-estimate W 2 based on X' 
we obtain the following estimate for W, 

W(X') = \/-0.03 + 0.173A' / . (16) 
The R 2 = .0924, SE = .0106, F(l,724) = 73.725 and the p-level less than 
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Figure 9: Estimate of the square of the spread W 2 of the output frequency 
of Is as a function of the system's complexity X 



0.00000. The Durbin- Watson d = 1.66. This estimate of the spread agrees 
with the rate predicted by the theory (pi). To see this, let x be the in- 
put sequence, let the system be the selection rule R with a system com- 
plexity K(R\n), let R(x) be the output subsequence (consisting only of bi- 
nary values ±1), let v{R(x)) be the frequency of Is in this subsequence 
and take the deficiency of randomness 5(x\n) of the input sequence to be 
zero (since the input sequence is maximally random). Then the theoretical 
rate of the maximal possible deviation (spread) between u(R(x)) and 1/2 is 
0{y/K{R\n)/i{R{x))). This is the same rate in which the estimate of spread 
W grows with respect to the X' in (16). 

To summarize, the results above imply that a system based on classical 
equations of mechanics that consists of a vibrating solid subjected to ex- 
ternal random input-force acts like an algorithmic selection rule of a finite 
complexity. It produces an output sequence whose stochastic and chaotic 
properties are effected by the system's complexity as predicted by the the- 
ory of algorithmic randomness. The results confirm the model of [16J. 



16 



Distribution of Raw residuals 
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Figure 10: Distribution of residuals wf — W 2 (xi) 
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Example of a complex System force (M=0.043) 




Figure 12: Response to a random input force sequence (applied at position 
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Example of no System force (M=0.03) 
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Example of a medium complexity System force (M=0.035) 
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Figure 14: Response to a random input force sequence (applied at position 
0). System's vibrating force (at position 15) has a mid-level complexity. 
Output is seen to be of lower complexity than the example in Figure [1~3| 
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Example of a complex System force (M=0.042): No Input 




Figure 15: The no-input response to a system's force (at position 15) of high 
complexity. 
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Example of a simple System force (M=0.031): No Input 
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Figure 16: The no-input response to a system's force (at position 15) of low 
complexity. 



23 



